Papers with parameter updating
COMEM: In-Context Retrieval-Augmented Mass-Editing Memory in Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for "knowledge editing" in large language models are inadequate . authors propose a method that can be used to update outdated information or correct false information . |
| Approach: | They propose a unified knowledge editing method called in-COntext retrieval-augmented Mass-Editing Memory . it incorporates retrieval augmented IKE, a novel extension of IKE designed for massive editing tasks . |
| Outcome: | The proposed method outperforms existing methods on the zsRE and CounterFact datasets. |
Semantic Alignment with Calibrated Similarity for Multilingual Sentence Embedding (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for learning semantic similarity between two English sentences have focused on one sub-task and therefore showed biased performance. |
| Approach: | They propose a method to learn semantic similarity between two English sentences using siamese networks. |
| Outcome: | The proposed method improves on both sub-tasks and predicts similarity scores in 14 languages. |
Can We Edit Factual Knowledge by In-Context Learning? (2023.emnlp-main)
Copied to clipboard
| Challenge: | In-context knowledge editing (IKE) is a new paradigm for NLP research that can be applied to large language models with tens or hundreds of parameters. |
| Approach: | They propose to use in-context knowledge editing (IKE) without gradient updating to edit factual knowledge without a gradient update. |
| Outcome: | The proposed method achieves a competitive success rate compared to gradient-based methods on GPT-J but with fewer side effects. |
On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Evidence-enhanced detectors are able to detect malicious social text, but they are prone to evidence pollution. |
| Approach: | They propose three defense strategies to mitigate evidence pollution by large language models by machine-generated text detection and a mixture of experts. |
| Outcome: | The proposed defense strategies could mitigate evidence pollution, but they faced limitations for practical employment. |
Teaching Large Language Models an Unseen Language on the Fly (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models struggle to support numerous low-resource languages . Existing models lack sufficient training data for effective parameter updating . |
| Approach: | They propose a framework for adapting LLMs to unseen languages by in-context learning. |
| Outcome: | The proposed framework improves Chinese-to-Zhuang translation performance and Zhuan-to Chinese translation performance. |
Parameter-Aware Contrastive Knowledge Editing: Tracing and Rectifying based on Critical Transmission Paths (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) encode vast amounts of knowledge in their parameters, but the acquired knowledge can be incorrect or outdated over time, necessitating rectification after pre-training. |
| Approach: | They propose a method that captures key information flows that influence model predictions . they propose 'critical transmission paths' to improve model editing . |
| Outcome: | The proposed method improves on two prominent datasets and three widely used LLMs. |